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Abstract 


To address the training needs of Further Education and Training college (FETC) 
lecturers, and in the absence of a full professional education qualification, several higher 
education institutions, FETCs, and other bodies in South Africa formed an alliance to 
develop a short programme towards a possible future full qualification. In 2010 a 
Vocational Education Orientation Programme (VEOP) was piloted. In line with the 
responsibility for quality assurance, and the need to inform further developments in the 
training of FETC lecturers, the aim of this research was to evaluate the VEOP presented 
by the University of the Free State (UFS). To reach the stated aim, a two phase 
evaluative study was undertaken (1) to assess the individual modules, and (2) to 
holistically investigate the quality of the programme. Two questionnaires were used to 
gather data. The first set of data was collected at the completion of each of the six 
modules. For the second phase of the study, 48 lecturer-students were randomly 
selected more than a year after completion of the VEOP. The study identified a number 
of strengths and weaknesses of the VEOP. The results emphasise the need to carefully 
select tutors and train them to have an understanding of the FETC milieu, rethink the 
methodology employed in the education training of FETC lecturers, and redesign the 
modules’ contents to better reflect the FETC sector. The need to enhance student 
support and improve administration is also highlighted by the study. The results of the 
study may inform the development of a full qualification for FETC lecturers. 

Keywords: Distance education; further education and training; programme 
evaluation; South Africa; sub-Saharan Africa; vocational training 
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Background to the Study 


Changes in the labour market and in the worlds of work have influenced the provision of 
educational services. Much is expected from the Further Education and Training College 
(FETC) sector in South Africa to provide intermediate-level and artisan skills. There is a 
significant shortage of people to fill positions in the technical and associated 
professional occupational categories and, if skilled, they will alleviate the massive 
unemployment problem in the country (DHET, 2012a; Powell, 2012). FETCs provide 
pre-service training to young students, up-skilling, and the retraining of adults, as well 
as supporting adult students through literacy and numeracy training (Powell, 2012). In 
2013 more than 600,000 students were studying at 50 FETC in South Africa (Financial 
Mail, 2013). FETC lecturers are “a crucial component in the skills development 
challenge in South Africa” (Akoojee, 2008, p. 310). The work environments of FET 
lecturers are complex and continually changing (Williams, 2010). Increasing student 
numbers and broadening of programmes offered need to be matched by an 
improvement in the quality and quantity of the lecturers (Akoojee, 2008). The need for 
FET lecturers to develop contemporary skills in teaching, learning, and assessment 
(Williams, 2010) was acknowledged by the South African Department of Higher 
Education and Training (DHET). In the Government Gazette of 28 August, 2009, the 
DHET proposed The National Policy Framework for Lecturer Qualifications and 
Development in FET Colleges in South Africa. The intention was to establish “a national 
standard for lecturers in FET colleges” within the landscape of global competitive 
markets (DHET, 2009, p. 4). The aim of the framework was to ensure that FETC 
lecturers enhance their professional competence and performance, and to equip them 
for their essential and demanding teaching and assessment tasks. On 21 August, 2012, 
the second draft of this policy framework, the Policy on Professional Qualifications for 
Further Education and Training College Lecturers, was published. It differs radically 
from the first document. It has been aligned with the Higher Education Qualifications 
Framework (HEQF), and now requires currently employed lecturers to complete a 
Diploma in Vocational Education (DHET, 2012b). This is in line with international 
trends to move FETC lecturers’ training towards professionalisation, standardisation, 
and certification (Papier, 2010a). 

While the finalisation of a framework for FETC lecturer qualifications is still in process, 
the need for training these lecturers is a pressing concern. Papier (2010b, pp. 1-2) states 
that “there is an urgent need for national authorities to address the training concerns of 
college lecturers by finalising the framework” while emphasising the importance of 
acknowledging the difference in training needs between FETC lecturers and school 
teachers. Papier (2010b) also highlights the low morale of the FETC personnel, as a 
result of insufficient action towards the professionalisation of the lecturers, and the 
concerns of FETC lecturers about their pedagogical knowledge and workplace exposure. 
Nkosi (2012) specifically mentions FETC students’ discontent as a result of a deficit of 
management and governance skills amongst FET staff. Furthermore, he refers to the 
lack of qualified FETC lecturers at colleges in South Africa. Using the National Policy 
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Framework for Teacher Education and Development in South Africa which specifies 
that all school teachers must have a degree, as a benchmark to evaluate FETC lecturers’ 
qualification, Cosser, Kraak, and Winnaar (2011) found that in 2010, 57% of FETC 
lecturers have less than a degree/higher diploma. 

To address the training needs of FETC lecturers and in the absence of a full 
qualification, several higher education institutions, FETCs, and other bodies formed an 
alliance to develop a 30-credit short programme towards a possible future 120-credit 
Vocational Education Certificate (Level 5) (DHET, 2012b). In 2010, a Vocational 
Education Orientation Programme (VEOP) was piloted and continues to be delivered. 
The VEOP aims to 


• initiate FET lecturers to the FETC policies, context, and skills environment; 

• enable FET lecturers to interpret curricula and plan relevant learning and 
assessment activities; 

• facilitate the discovery of appropriate integrated teaching and assessment 
strategies; 

• develop an understanding by FET lecturers of learners, learning processes, and a 
culture conducive to learning; and 

• enable FET lecturers to manage administration processes. (DHET, 2012b) 

Several principles underpin the VEOP, namely practical classroom application; relevant 
theory; respect for adult learners and their previous experience and contribution; 
cultural diversity, tolerance, language appreciation and inclusivity; innovative teaching 
and learning strategies; the context of a lecturer’s subject specialisation; an 
understanding of the future workplace of learners; and assessment which should 
include classroom observation and guidance (DHET, 2012b). 


The VEOP offered by the School of Open Learning (SOL), in conjunction with the 
Faculty of Education of the University of the Free State (UFS), is aligned with the 
abovementioned general aims and principles agreed upon by the aforesaid alliance. It is 
a 30-credit short course at the HEQF Level 5. The VEOP consists of 300 notional hours 
that includes contact time, self-study, classroom practice, and assessment. It offers 6 
modules developed by the UFS, and a seventh developed by the Swiss-South African Co¬ 
operation Initiative. Table 1 provides the layout of the modules. 

Table 1 


Modules Offered in the VEOP 


Module Credits Title of module 

1 2 The FET college: policy and workplace contexts 

2 8 Methodology: integrated teaching and assessment 

3 5 Conducting and managing assessment 

4 6 Curriculum interpretation and planning 

5 4 Understanding and managing the learner 

6 1 Becoming a reflective practitioner 

7 4 Workplace-based experience 
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In August 2010, the first cohort of 256 FETC lecturers was registered for the VEOP pilot 
programme of the UFS, in five centres: Bloemfontein (63), Thaba ’Nchu (21), Kroonstad 
(31), Sasolburg (30), and Qwaqwa (111). The lecturers completed their programme in 
April 2011. Of these 256 lecturer-students, 171 (66.8%) completed the programme 
successfully. 

The VEOP offered by the SOL is essentially a distance programme, with limited contact. 
The Association for the Development of Education in Africa (ADEA) (2002) found with 
increasing demand for access to educational opportunities at all levels, and the often 
decreasing budget in real terms for education provision, there has been a growing 
interest in sub-Saharan Africa in the possibilities of distance education as an important 
and credible part of education delivery strategy designed to enable greater access to 
quality education. Distance education as a complementary mode of delivery is often 
used for initial teacher training as well as teacher development in sub-Saharan Africa 
(ADEA, 2002), Latin America and South Asia (Perraton, 2007), Turkey (Giiltekin, 
2009), India (Mishra, Vijayshri, & Garg, 2009), the United Kingdom (Sampong, 2009; 
Wilson, 2008), and Australia (Sampong, 2009). 

Distance education as a complementary mode of delivery was initiated as an effort to 
overcome the challenges of access, equity, cost effectiveness, and quality for higher 
education (cf. Sampson, 2003). Perraton (2007) defines distance education as “an 
educational process in which a significant proportion of the teaching is conducted by 
someone removed in space and/or time from the learner” (p. 12). Sikwibele and Mungoo 
(2009) expand on this definition and argue that distance education refers to 

... a planned and regular educational provision where 
there is distance between the instructor and the learner. 

Generally most conceptions [of distance education] point 
to the following features : (a) absence of a teacher, (b) 
use of mixed media in teaching and learning, (c) 
correspondence, (d) independent learning, and (e) 
possibility of face-to-face meetings with tutors, (p. 4) 

Sampson (2003) found that distance education serves those who cannot or do not want 
to make use of traditional classroom teaching. Demanding professional commitments 
and family responsibilities often make attending a conventional, full-time, face-to-face 
course with fixed timetables impossible (Sampson, 2003). Sikwibele and Mungoo 
(2009) additionally list the following benefits of distance education: It allows the 
training of more people, it can be delivered to home and work sites, and it is learner- 
centred and affords students more control of the pace and learning styles. Distance 
education is thus convenient, flexible, and adaptable. This suits full-time professionals 
such as FETC lecturers. Distance education methods have been used to teach, develop, 
and support teachers for many years (Aluko, 2009; Mishra et al., 2009). The 
effectiveness of distance education for teacher training is well documented (cf. Aluko, 
2009). Distance education is thus the only viable option for reaching groups of FETC 


Vol 14 | No 4 


Oct/13 


71 





Evaluation of the Vocational Education Orientation Programme (VEOP) at a University in South Africa 


Jacobs and De Wet 


lecturers who are full time employees at FETC in often remote rural areas. As an in- 
service training programme the VEOP does not deplete FETC of lecturers as they learn 
as they work. 

The two most important problems associated with distance education are high attrition 
rates and quality assurance (Sikwibele & Mungoo, 2009). It is therefore understandable 
that quality assurance is an important research area in distance education (Zawacki- 
Richter, 2009). Programme evaluation is an essential aspect of quality assurance. 


Evaluation of the Programme 


The need for higher education institutions to evaluate themselves continuously is 
highlighted by the HEQC of the Council on Higher Education (CHE, 2005) which states 
that 


Primary responsibility for programme quality rests with 
higher education institutions themselves. Institutions 
should seek to establish and sustain effective 
mechanisms that facilitate programme quality and yield 
reliable information for internal programme-related 
planning and self-evaluation, external evaluation, and 
public reporting, (p. 6) 

Aluko (2009) argues that measuring the success of any educational programme has 
been recognised as an important and fundamental form of institutional accountability. 
Sampong (2009), moreover, believes that successful programme development cannot 
occur without evaluation. In distance education, programme evaluation encompasses 
the evaluation of programme objectives, content, instructional design, support services, 
assessment practices, student achievement, and the use/impact of technology to 
improve the quality of teaching-learning, to enhance the relevance of the programme, to 
access how the programme is perceived by its stakeholders and meet their expectations, 
and to provide regular feedback on the factors that affect outcomes (Mishra et ah, 
2009). In the evaluation of distance education programmes, cognisance should also be 
taken of the American Distance Education Consortium’s (ADEC) principles for good 
practice: 

• Design for active and effective learning by considering the needs and 
characteristics of the learners, the nature of the content, appropriate 
instructional strategies and technologies, and the desired learning outcomes. 

• Support the needs of the learners by providing advisory, technical, and library 
support. 

• Develop and maintain technological and human infrastructure. 
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• Sustain administrative and organisational commitment to quality by integrating 
distance education into the mission, providing financial commitment, including 
faculty development and rewards, training to support those involved, and 
including marketing and management structures to promote and sustain 
distance education programmes. (Buford, 2005) 

Feedback instruments designed to help Australian training organisations to measure the 
quality of vocational education and training include items on trainer quality, 
satisfaction, effective assessment, clear expectations, learning stimulation, training 
relevance, competency development, training resources, effective support, and active 
learning (Coates, 2009). 

VEOP presented by the SOL is essentially a distance programme, with limited contact 
sessions intended for FETC lecturers. The evaluation of the VEOP was consequently 
guided by ADEC’s principles for good practice (Buford, 2005), as well as Sampong’s 
(2009) and Coates’s (2009) guidelines for distance and FET evaluation, respectively. 


Aim of the Study 


In line with the responsibility for quality assurance, and the need to inform further 
developments in the training of FETC lecturers, the aim of this research was to evaluate 
the VEOP presented by the UFS. To reach the stated aim, a two phase evaluative study 
was undertaken (1) to assess the individual modules, and (2) to holistically investigate 
the quality of the programme. The programme evaluation is aimed at improving the 
current programme, as well as informing the role-players towards the development of a 
full qualification. The DHET (2012b) anticipates that the VEOP will form an integral 
part of the Diploma in Vocational Education. 


Research Method 


Survey instruments have been identified as being the most popular data collection tools 
in outcomes measurements and evaluation (Aluko, 2009; Sampson, 2003). Two 
questionnaires were used to gather data about the student-lecturers’ views of the VEOP 
at the UFS. The first questionnaire was developed by the staff of the quality assurance 
office of SOL. It has been used numerous times since 2005 to elicit the views of students 
on the different modules that form part of a wide variety of education programmes 
administered by SOL. The survey instrument used during the second phase of the study, 
compiled by the authors, was based on the content of the programme documentation 
submitted for accreditation. It was piloted in 2012 using 10 students from Bloemfontein 
(where the university is located) who did not form part of the sample in the study. The 
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pilot process enabled the researchers to improve some questions which appeared to be 
ambiguous. 

Items in both questionnaires relied heavily on existing programme evaluation 
questionnaires and observed evidence (cf. Coates, 2009; Mishra et al., 2009; Sampong, 
2009; Sampson, 2003; Taylor-Powell & Renner, 2000). The questions in the second 
survey were also based on the learning outcomes of the programme, as well as the 
principles that guide the programme (cf. Aluko, 2009). The researchers, furthermore, 
entered into lengthy discussions with the dean and the director of short courses at SOL 
to determine their perspectives on VEOP, their expectations of the evaluative study, and 
their views on the future of VEOP at SOL. They also acted as critical readers in the 
development of the questionnaire used during the second phase of the study. Insights 
gained from the discussions were incorporated into the questionnaire. 

The data were captured and checked for accuracy by an experienced typist. The data 
were analysed, using the STATAIC11 software. 

The data were analysed using the mean score, as a measure of centrality, and the 
standard deviation, as a measure of spread, to summarise the data. We then explored 
the differences in measurements between groups, using techniques that are typically 
used in inferential studies (the student’s t -test and the one-way ANOVAJ. However, in 
this study, we do not claim inferences beyond this case; we used the techniques to 
merely differentiate between groups to gain partial insights into the VEOP programme 
at this institution. 

The internal reliability of the questionnaires was checked by calculating the Cronbach’s 
alpha coefficient. The overall Cronbach’s alpha coefficient for the rated responses during 
the first and second phases of the study was calculated to be 0.9002 and 0.9532 
respectively, which indicates that the responses have a high level of reliability. 

Sampling and Data Collection 

The first set of data was collected at the completion of each of the modules during 2011. 
Each lecturer-student received a module evaluation form on completion of each of the 
first six modules, on which they could provide feedback on their experiences during the 
module. Of the 1,536 evaluation forms distributed to lecturer-students, 418 were 
returned of which 412 could be used. 

The second set of data was collected from the same cohort of students during 2012 more 
than a year after the lecturer-students had completed the short programme. This survey 
was purposefully conducted after a substantial time had elapsed after completing the 
programme, to allow the lecturer-students to reflect on their experiences in the year 
following the programme. This survey focused on the quality of the programme, and not 
on specific modules, although the outcomes of the various modules were included as 
part of the purpose of the programme. For the second phase of the study, 60 lecturer- 


| Vol 14 | No 4 


Oct/13 


74 





Evaluation of the Vocational Education Orientation Programme (VEOP) at a University in South Africa 


Jacobs and De Wet 


students were randomly selected from three campuses, also randomly selected. They 
were telephonically invited to participate in the survey. Of the lecturer-students, 48 
agreed to take part in the survey. The survey questionnaire was hand-delivered to each 
of them by an independent courier, commissioned by SOL, who had no connection or 
interest in the programme. The participants responded to the questionnaire at their 
convenience, sealed the questionnaire in the envelope provided, after which it was 
collected by the courier. 

Ethical Considerations 

Permission for this study was obtained from the dean of the SOL, as well as from the 
director of this programme. The participants’ dignity, privacy, and interests were 
respected at all times. With the exception of a question asking the participants to 
indicate the campus at which they study/studied, the questionnaires did not contain any 
identifying aspects, names, addresses, or code symbols. Before completing the 
questionnaires, the participants were informed that the process was completely 
voluntary and that they could withdraw at any stage during the process. They were also 
informed during the first phase of the study that whether they chose to participate or 
not would have no effect on their grades or evaluation. The questionnaires were 
collected by administrators from the quality assurance office and not the tutors of the 
modules. They received no financial or other reward for taking part in this study. 


Results of the Study 


The most important results of the study are reported below, based on feedback from 
both surveys. 

First Phase of the Study 

The first survey focused on the quality of the modules relating to four aspects, namely 
the content of the modules, the teaching and learning related to the module, the 
teaching material, and the assessment during the module. The lecturer-students had to 
relate their experiences of each of the modules on a 5-point Likert-scale (ranging from 
strong disagreement to strong agreement). As a score of 3 indicates neither a positive 
nor a negative response, and only 4 and 5 indicate an agreement, any mean score of less 
than 4 should raise concerns, in terms of the quality of the specific module. 

In discussing the results, the four aspects related to the modules will first be analysed 
(Table 2); thereafter, a comparison will be made of how the various modules were rated 
(Table 3). Aggregated ratings are provided in Table 2. 
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Table 2 


Aggregated Feedback on Aspects of the Modules 


Aspects 

Mean (M) 

SD is) 

Content 

4.0336 

0.3892 

Teaching and learning 

3.8808 

0.8350 

Study material 

3-5231 

0.8270 

Assessment 

4.0867 

0.4448 

Combined 

3.8811 

0.5698 


From the combined score it can be seen that the respondents perceived the assessment 
to be the best aspect of the modules {M = 4.0867), followed by the content (M = 
4-0336). The study material seems to need the most attention (M = 3.5231), and then 
also the teaching and learning aspects (M = 3.8808). The aggregated scores of the 
respondents on details regarding each of the four aspects are summarised in Table 3 
(ranked from highest to lowest per aspect). 

Table 3 


Lecturer-Students’ Perceptions on Details Regarding the Various Modules 




Mean 

M 

Standard 

deviation 

s 


There was a link between the module content and the 

4.086 

0.761 

-M 

£ 

C1) 

learning outcomes 

C 

O 

The content provides the opportunity to develop skills 

4.085 

0.791 

0 

The content of the module linked up well with other 


0.808 

0 ) 

"3 

modules in the programme 

4.044 

0 

§ 

The content of the module is understandable 

4-034 

0.821 


The content of the modules is well organised 

3-927 

0.862 

bJO 

fl 

'3 

The lecturer encouraged student participation in class 

4-385* 

0.796 

The module has developed my subject knowledge 

4.226 

0.852 

c& 

Opportunities were created for the application of the 
theory 

4.127 

0-799 

bJO 

The teaching activities helped me to achieve the stated 

4.107 

0-779 

C 

2 

learning outcomes of this module 

<D 

The time was sufficient to achieve the outcomes 

3-951 

0-995 

H 

The lecturer used teaching aids effectively 

2.929# 

1.368 

bJOr-J 

.3 

■p Sh 

H-h Q) 

The study guide was a valuable aid to learning 

4.012 

0.858 

O +_i 

cd cd 

H s 

Additional teaching materials were valuable aids to 
learning 

3-037 

1-349 
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Standard 

deviation 

s 



The lecturer returned marked work within a 
reasonable time frame (e.g. two weeks) 

4.218 

0-975 

-M 

Ch 

<D 

B 

The feedback on the assessment helped me learn from 
my mistakes 

4-193 

0.839 

C/2 

C/2 

<D 

Assessment tasks were linked to module outcomes 

4.118 

0.687 

C/2 

C/2 

<1 

Assessment criteria were applied consistently 

4.015 

0-797 


The assessment criteria were clear 

3-998 

0.878 


The assessment tasks were clear 

3-998 

0.873 


Rated the highest 


# Rated the lowest 


The issues that were rated the highest were the encouragement from the lecturer 
towards student participation (M = 4.385), the extent to which the module enhanced 
the student’s subject knowledge (M = 4.226), and a reasonable timeframe within which 
submitted assessment tasks were returned (M = 4.218). The two issues that need the 
most attention are the lack of effective use of teaching aids (M = 2.929) and the lack of 
valuable additional teaching material (M = 3.037). Other issues that need some 
improvement are the organisation of the module content (M = 3.927), time 
management (M = 3.951), and clarity with regard to the assessment criteria and tasks 
(M = 3.998). 

Respondents’ ratings on various aspects of the different modules were also investigated. 
The details are provided in Table 4. 
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Table 4 

Average Rating on Various Aspects, per Module (Ranked) 


Aspects 

Modules 

Content 

Teaching 

and 

learning 

Study 

material 

Assess¬ 

ment 

Combined 

Understanding and 
managing the 
learner (module 5) 

4.2897* 

4.0793 

3.7069 

4.4414* 

4.1276* 

Becoming a 
reflective 

practitioner (module 

6) 

4.2286 

4-1393* 

3-7143* 

4-2536 

4.0857 

Conducting and 
managing 

assessment (module 

3) 

4.2322 

3.9966 

3.6494 

4.2023 

4.0184 

Curriculum 
interpretation and 
planning (module 4) 

4.0913 

3.8837 

3-4511 

4.0913 

3.8804 

Methodology: 
integrated teaching 
and assessment 
(module 2) 

3.9106 

3.8082 

3-5235 

3-9894 

3-8059 

The FET College: 
policy and workplace 
contexts 
(module 1) 

3-7556# 

3.6923# 

3-3571# 

3.8978# 

3.6791# 


Highest score per aspect 


# Lowest score per aspect 


Module 5 (Understanding and managing the learner) scored the highest overall (M = 
4.1276), as well as on aspects pertaining to content (M = 4.2897) and assessment (M = 
4.4414). The module with the second overall highest score ( M = 4.0857) was module 6 
(Workplace-based experience). Module 1 (The FET College: policy and workplace 
contexts) scored the lowest overall ( M = 3.6791), as well as on each aspect that was 
explored in the survey. The module that scored the second-lowest overall was module 2 
(Methodology: integrated teaching and assessment). 

The statistical significance of the differences in mean scores was explored, using the 
one-way ANOVA. No statistically significant differences were found between the study 
materials’ rating in the different modules. Statistically significant differences were found 
between the content (p = 0.0000), teaching and learning (p = 0.0004), and assessment 
ip = 0.0002) ratings in the different modules. 
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The Sheffe post-hoc test showed a number of statistical differences: 

• The content of module 1 scored significantly lower than that of module 3 [p = 
0.000), module 4 (p = 0.025), module 5 (p = 0.008), and module 6 (p = 0.036). 

• The content of module 2 scored significantly lower than that of module 3 ( p= 

0.049)- 

• The teaching and learning aspects of module 1 scored statistically significantly 
lower than those of module 3 (p = 0.037) and module 6 (p = 0.031). 

• The assessment during module 1 was rated significantly lower than that of 
module 5 (p = 0.006). 

• The assessment during module 2 was rated significantly lower than that of 
module 5 (p = 0.048). 

• The overall rating of module 1 is significantly lower than that of module 3 (p = 
0.006), module 5 (p = 0.015), and module 6 (p = 0.045). 

While none of the modules scored below the point of neutrality (i.e., 3) on any of the 
aspects, in terms of quality assurance, SOL’s aim is, at least, to be good (a score of 4). 
While experiences pertaining to teaching and learning seem to be similar during the 
different modules, the content and assessment of module 1 and module 2 seems to need 
improvement, while these aspects of module 5 can be commended. 

Whereas the evaluation during the first phase of the study focused on the various 
modules offered in the programme, and feedback obtained immediately after 
completion of the modules, the second phase of the study focused on the programme 
per se. 

Results from the Second Phase of the Study 

The questionnaire used during the second phase of the study contained mainly closed 
questions, in which the participants were requested to respond to statements on a 5- 
point Likert-scale (ranging from strong disagreement to strong agreement ). As a score 
of 3 indicates neither a positive nor a negative response, and only 4 and 5 indicate an 
agreement, any mean score of less than 4 should raise concerns, in terms of the quality 
of the specific programme. 

The survey was aimed at four specific categories of issues pertaining to the VEOP, 
namely 1) issues generic to all programmes (standards, administration, mode of 
presentation, etc.); 2) issues pertaining to the campus where the lecturer-students 
attend the programme (administration, presentation, etc.); 3) the purpose of the 
programme; and 4) the principles underpinning the programme. Furthermore, the 
respondents’ general perceptions of the module that they experience the most positively, 
compared to the module that they experience most negatively, were obtained. 

The combined score on all the items in the questionnaire is 3.975 (with a standard 
deviation of 0.777), just below the benchmark of good (i.e., 4.000). The participants’ 
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scoring on the four constructs are summarised in Table 5 (ranked from highest to 
lowest). 

Table 5 

Categories of Issues Appraised in the Survey 


The level to which the stated principles underpinning the 
programme was experienced by the participants. 

The extent to which the purpose and aim of the programme 
was achieved. 

The level of satisfaction with the campus at which the 
programme is offered. 

The level of satisfaction with generic issues pertaining to the 
programme. 

* Highest score 


Mean 

SD 

M 

s 

4-0324* 

0-7797 

3.9722 

0.9012 

3-9444 

0.7024 

3.9021# 

0.8235 


Lowest score 


From the responses, summarised in Table 5, it seems as if the principles that were 
stated indeed informed the programme (M = 4.0324), while the respondents were the 
least satisfied with generic issues pertaining to the programme (M = 3.9021). The 
details of these issues, on which the respondents were probed, are provided in Table 6. 

Table 6 

Details, Relating to the Issues, on which Participants were Probed (Ranked per Issue) 

Mean SD 

M s 


Generic issues 

The study material was of a good standard. 

I am pleased that I did the VEOP course. 

I was comfortable with the assessment activities that were 
used. 

I am satisfied with the standard of the VEOP. 

The administration of the VEOP at the UFS is good. 


Issues pertaining to the campus 

I am pleased with the way the course was presented. 

4.0000 

0.8251 

I am positive about the tutors on the VEOP. 

3-9375 

0.9087 

The administration of the VEOP at my campus is good. 

3-8958 

0-9944 

Issues relating to the purpose and aims of the qualification 

I now have a better understanding of the processes of 
learning. 

4.1042 

0.9728 

I am now better equipped to plan relevant learning 
activities. 

4.0417 

1.0097 


4.1875 0.8419 

3.8958 1.2922 

3.8542 0.9673 

3.8125 1.0033 

3.7872# 1.1021 
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Mean SD 

M s 


I am now better prepared to plan relevant assessment 
activities. 

4.0208 

1.0617 

The programme stimulated self-reflection. 

4.0000 

0.9676 

I now have a basic understanding of how to use research 
towards improving my own practice. 

4.0000 

1.0719 

The VEOP provided me with an understanding of the FET 
environment. 

4.0000 

1.0314 

The VEOP gave me insight into FETC policies. 

3.9792 

1.0208 

The course helped me to understand my students better. 

3.9792 

1.0816 

The VEOP improved my ability to interpret the 
curriculum. 

3.9167 

1.0686 

I am more able to use integrated teaching and assessment 
strategies than before I completed the programme. 

3-8958 

1.0766 

My insight into the fostering of a culture of learning 
improved. 

3-8750 

1.1228 

My management and administration skills improved. 

3-8542 

1.1667 

Issues relating to the principles underpinning the programme 

I felt accepted and included during the course. 

4.2083* 

0.7978 

The VEOP was relevant to my work. 

4.1915 

0.9921 

During the course, I felt respected. 

4.1042 

0.9280 

The assessment was relevant to my work situation. 

4.0625 

0.9087 

I was able to apply the learning experience to the context 
of my subject specialisation. 

4.0000 

0.9225 

I can apply what I have learned in my classroom. 

3.9792 

1.0617 

I do apply what I have learned in my classroom. 

3.9167 

1.0280 

My previous experience and expertise was acknowledged 
and appreciated. 

3-8125 

1.0650 


Highest score 


# Lowest score 


What was rated the highest by the respondents is that they felt accepted and included 
during the course (M = 4.2083), that they experienced the VEOP as relevant to their 
work (M = 4.1915), and that they perceived the study material to be of a good standard 
(M = 4.1875). Issues that scored the lowest were the administration of the VEOP at the 
UFS (M = 3.7872), the acknowledgement and appreciation of previous experience and 
expertise (M = 3.8125), and the standard of the VEOP (M = 3.8125). It should, however, 
be noted that while all of the aspects explored scored above the point of neutrality (i.e., 
3), many scored below the standard of good (i.e., 4). 

To complement the module evaluations done during the first phase of the study, the 
modules were evaluated holistically: The student-lecturers were asked to rate the 
modules in terms of the module they rated the highest and the lowest. The results are 
displayed in two graphs. 
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Module l - The FET College: Policy and 
workplace contexts 



Module 6 - Becoming a reflective practitioner 3 


Module 5 - Understanding and managingthe 
learner 


Module 7 - W orkplace-based experience 



8 


Module 4 - Curriculum interpretation and 
planning 



8 


Module 3 - Conducting and managing assessment 



Module 2 - Methodology 7 : Integrated teaching and 
assessment 


Figure 1. Modules rated as the best by the participants. 


Module 1 - The FET College: Policy and 
workplace contexts 

Module 7 - Workplace-based experience 

Module 2 - Methodology 7 : Integrated teaching and 
assessment 


Module 6 - Becoming a reflective practitioner 

Module 4 - Curriculum interpretation and 
planning 

Module 5 - Understanding and managingthe 
learner 


Module 3 - Conducting and managing assessment 





Figure 2. Modules rated as the worst by the participants. 
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While different lecturer-students rated the modules differently, the one module that 
stands out as problematic is module 1. It was rated the lowest by the majority of the 
participants, and scored the highest by only two participants. Using the rank order of 
Figure 1 and inverting the rank order of Figure 2, and then combining the two rankings, 
the rating of the modules is as follows: 

1. Conducting and managing assessment (module 3) 

2. Curriculum interpretation and planning (module 4) 

3. Methodology: integrated teaching and assessment (module 2) 

4. Understanding and managing the learner (module 5) 

5. Becoming a reflective practitioner (module 6) 

6. Workplace-based experience (module 7) 

7. The FET College: policy and workplace contexts (module 1) 

While the students have different perspectives on which of the modules are the best, it is 
clear that module 1 is regarded as the module that needs the most improvement. 


Discussion 


The need for self appraisal in any programme is essential as it allows the institute 
offering the programme to reflect on the strengths and weaknesses of the programme. 
The insights gained in the process allow for improvement, growth, and development. 
This is even more important for any new programme and specifically a programme such 
as VEOP, where the training of FETC lecturers is not only a new field in Higher 
Education in South Africa, but still to be developed into a new complete qualification. 

During the two-phase programme evaluation, a number of strengths emerged: During 
the evaluation of the different modules, the respondents were, in general, positive about 
the content of the various modules and indicated that they enhanced their knowledge. 
The respondents were furthermore satisfied with the assessment during the modules 
and specifically indicated that the assessment tasks were marked and returned within a 
reasonable time. From the responses of the participants in the programme evaluation 
survey, it seems as if the principles that were stated were experienced by the lecturer- 
students. The lecturer-students seem to appreciate the encouragement of the tutors 
towards student participation. What was rated the highest by the respondents is that 
they felt accepted and included during the course, that they experienced the VEOP 
relevant to their work, and that they perceived the study material to be of a good 
standard. These positives resonate well with ADEC’s principles for good practice in 
distance education (cf. Buford, 2005). 

However, not all experiences by lecturer-students were positive. A number of deficits in 
the programme became clear in this study. Lecturer-students indicated that tutors do 
not use teaching aids effectively. The additional learning material was indicated to be 
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insufficient, while the organisation of the module content needed some improvement. 
Module 1 (the FET college: policy and workplace contexts), as well as module 2 
(Methodology: integrated teaching and assessment) were rated the lowest during the 
module evaluation. Some issues were specifically pointed out as needing improvement, 
namely the content of modules 1 and 2, as well as the assessment, teaching, and learning 
during module 1. In the final programme evaluation, module 1 was again indicated as 
the one module with which the students are not satisfied. Respondents indicated that 
time to achieve the different modules’ outcomes was not enough. Issues that scored the 
lowest by the respondents in the second survey were the administration of the VEOP at 
the UFS, and the acknowledgement and appreciation of previous experience. 

Respondents who believe that they do not have enough time to achieve the module 
outcomes (cf. Table 3) correspond with previous research. Mishra et al. (2009) also 
highlight distance learners’ “acute shortage of time” (p. 114). They attribute this problem 
to the societal, familial, and personal commitments of distance learners. According to 
these authors, a frequently asked question concerns the number of hours they must 
study every day or in a week to successfully complete a programme in the minimum 
time, without compromising the quality of learning. This has, according to Mishra et al. 
(2009), implications for course design, development, and student workload. 

Printed self-instructional materials and the contact-sessions form the backbone of 
instruction in the VEOP. Therefore, evaluating various aspects of the module content, 
teaching material, and teaching and learning were concerns (Tables 3 and 4). This study 
reveals that although the students were, as a whole, satisfied with the module content of 
the different modules (Table 3), they grappled with the content and study material of 
module 1 (Table 4). The importance of unambiguous and sufficient learning materials 
should therefore be highlighted (cf. Mishra et al., 2009; Sampson, 2003). Mishra et al. 
(2009) furthermore stress that learning material, especially if it is lengthy and/or dense, 
“do(es) not fully substitute for the teacher” (p. 115). Gultekin (2009) notes that it is 
important that study material for distance learning is designed in accordance with 
distance teaching techniques that facilitate learning and are easily comprehended. 
Student satisfaction with study material is not only a condition for successful distance 
education, but is fairly common in distance education. This study (Table 3), as well as 
programme evaluation studies by Mishra et al. (2009) and Gultekin (2009), found that 
students were satisfied with the design and content of the study material. On-site 
facilitators are critical to the effectiveness of a distance education programme 
(Sampson, 2003). It is therefore heartening that lecturer-students who took part in this 
study are relatively satisfied with the conduct of the tutors towards them, because the 
tutors encouraged them to participate in class, returned marked work within a 
reasonable time frame, and are positive about the tutors (cf. Tables 3 and 6). 

Sampson (2003) finds that support is a key issue in distance education. Students who 
took part in Sampson’s (2003) study on the needs of M.Ed. education students were 
almost unanimous in stating their level of dissatisfaction with the amount of support 
they received. The lecture-students who took part in this study were also critical of the 
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administrative support they received. They evaluated the administration of the 
programme at the UFS, as well as on their respective campuses, as below the standard 
of good (i.e., 4) (cf. Table 6). Sampson (2003) believes that better co-ordinated 
administrative procedures that will allow for more effective communication between 
students and the university can reduce distance education students’ frustrations. 
Sampson (2003) cites Rumble (1992) who states that the key to successful management 
of distance education lies in planning, organisation, leadership, and control. 


Conclusions and Recommendations 


Module evaluation as a standard procedure by the SOL is a strong point as it enables 
constant evaluation towards addressing the shortfalls in modules. Creating 
opportunities for lecturer-students to give feedback on the programme in retrospect is 
considered a strength, as it allows the participants to reflect on how the programme has 
impacted on their performance at the FETC where they teach. 

The value of a study such as this is that it may lead to programme improvement. It is 
clear that the SOL has to rethink the methodology employed in VEOP, and redesign 
modules’ contents to better reflect the FETC sector, in order to appropriately train FETC 
lecturers. It is clear that the selection of tutors is crucial and that tutors should have a 
thorough understanding of the FETC milieu, as well as pedagogies suitable for FETC 
lecturers. It is furthermore recommended that the amount of work that is expected 
during the VEOP needs to be revised. Too much work was put into the programme that 
is, in reality, a short programme. As the VEOP will become part of the first year of a full 
new education qualification, these modules should just introduce students to these 
topics, and allow for expansion and progression in the modules that will be built on 
them. Accordingly, the amount of worked crammed into the course and the assignments 
given should be reconsidered. Most importantly, it is recommended that all modules 
have to be reviewed and partially or completely rewritten, informed by the insights 
gained through this study. VEOP is not a qualification, but a short course designed to be 
part of the new education qualification for FETC lecturers. It does not focus on 
vocational improvement, but, rather, on promoting teaching practices, as well as 
classroom and learner management of lecturers who train students for vocations. 
However, how it achieves the need to be enhanced in order to capture the nature and 
essence of the FETC sector more appropriately should be investigated. This study also 
highlighted the need to enhance student support and improve administration. 
Cognisance should therefore be taken of Sampson’s (2003) guidelines on how to 
improve planning, organisation, leadership, and control in distance education. 

The important role FET can play in economic and individual prosperity is acknowledged 
worldwide (Coates, 2009). This necessitates well qualified, knowledgeable FET 
lecturers. Whilst Williams (2010) is for example discussing the expansion and revision 
of FETC lecturers’ qualifications in a highly developed country (Australia), South Africa 
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is still debating the development of a full qualification for FET lecturers. The study has 
revealed the strengths and weaknesses of the VEOP presented by the SOL, and showed 
that distance education is the only viable delivery mode for this short programme in a 
country with limited resources. Sub-Saharan Africa and other developing countries 
should thus consider using distance education as a workable option to enhance the 
competencies of their FET lecturers. Without a competent labour force developing 
countries will never be able to effectively compete in the global marketplace. 

The following limitations of this study should be noted: The sample for this study was a 
single (the first) cohort of students registered for one VEOP programme. Results from 
this study can therefore not be generalised. The low response rate during the first phase 
of the study (27.2%) and the small sample size during the second phase of the study 
(only 48 of the first cohort of 256 lecturer-students [18.8%]) may also inhibit the 
generalisation of results. Key principles for the evaluation of distance education, such as 
the use of technology, as well as technical and library support for students, were not 
investigated (cf. Buford, 2005). We furthermore used two self-constructed 
questionnaires, which does not allow us to claim consistency of measurement over time. 
Despite these limitations, this study may inform the development of a full qualification 
for FETC lecturers. The FETC sector brings uniqueness to the education forum in the 
sense that it accommodates adolescent, youth, and adult learners. It also offers a rich 
mix of academic and vocation training that differs vastly from schools and universities. 
Any education and training effort in this field should take this uniqueness into 
consideration in its design, development, and offering, even more so when courses are 
designed and offered to the FETC lecturer cadre. 
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